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Abstract. We study the asymptotic eigenvalue distribution of Toeplitz matrices 
generated by a singular symbol. It has been conjectured by Widom that, for a generic 
symbol, the eigenvalues converge to the image of the symbol. In this paper we ask how 
the eigenvalues converge to the image. For a given Toeplitz matrix r„(a) of size n, 
we take the standard approach of looking at det(C — Tn{a)), of which the asymptotic 
information is given by the Fisher-Hartwig theorem. For a symbol with single jump, 
we obtain the distribution of eigenvalues as an expansion involving 1/n and logn/n. 
To demonstrate the validity of our result we compare our result against the numerics 
using a pure Fisher-Hartwig symbol. 
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1. Introduction 

Given a basis {ei,e2,...} in a Hilbert space, a linear operator A is represented by an 
infinite matrix whose element is given by aj^ = {ej, Ae^). A fundamental question that 
is obviously important in practical application is one about approximating the linear 
operator by finite matrices 

The study of Toeplitz system can be motivated by the same question, only being 
specified to the following situation. We take {e'^^^lfc G Z} as the basis for the functions 
defined on the unit circle T = {e^^|p G [— 7r,7r)}. We also assume the linear operator 
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A to be a multiplication operator, i.e. {Ailj){t) = a{t)il){t) with t = e^'P E T. Then the 
operator A is represented by the infinite matrix, 



The semi-infinite part (j and k is non-negative integer) of such matrix whose (j, A;)th 
component is given by aj_fc, is called Toeplitz matrix [2, 3J. 

The generating function a(e^^) is called the symbol of the Toeplitz Matrix, and it 
is a function from the unit circle T to complex number C. The n x n Toeplitz matrix 
generated from the symbol a is denoted by T„(a). We will call a(T) := {a(e'^)|p G 
[— 7r,7r)} the image of the symbol. 

Toeplitz matrices are ubiquitous in physics and mathematics ([HEllBj, just to name 
a few applications). In fact, the early development in the field arose from works on the 
two dimensional Ising model [3 [HI [9] where the spin-spin correlation function is written 
as a Toeplitz determinant. 

In all these applications, the asymptotics of Toeplitz determinants feature 
prominently. They are in many cases given by Szego's theorem [12j or by the Fisher- 
Hartwig theorem [131 E]- The former applies to smooth symbols whereas the latter 
contains singularities such as jumps and zeros. The case with singularities is much more 
complicated, is not fully understood, and still has open questionsj^l 

One of these questions (which was also raised in [16]) is: Given a set of n by 
n Toeplitz matrices, what can we say about the asymptotic eigenvalue distribution for 
large n? Since a Toeplitz matrix comes from a multiplication operator a{t) one may 
guess that the eigenvalues approximate the spectrum of the multiplication operator, 
which is simply the image of the symbol. Or, one may expect differently since the 
spectrum of an infinite Toeplitz matrix consists of the smallest convex set containing 
the image of the symbol. It was conjectured by Widom |18] that, except in rare cases, 
the eigenvalues approximate the image of the symbol as n grows. For instance, symbols 
containing a single jump singularity exhibits such behavior of eigenvalues [18] . According 
to an introductory review article [16] multiple singularities may lead to an interesting 
phenomena involving "stray eigenvalues" , which we do not consider in this paper. 

In this paper, we consider the eigenvalue distributions that approximate the image 
of the symbol. We ask how the eigenvalues approaches the image as n grows, i.e. what 
the deviation of the eigenvalues from the image isi§| 

Let us briefiy describe our method. An eigenvalue A of T„(a), an n x n Toeplitz 
matrix, is a solution of det[C — T„(a)] = 0. Therefore, the asymptotic information about 
the eigenvalues can be obtained from the asymptotic information of det[( — Tn{a)]. This 

I The Fisher-Hartwig theorem is promoted to a theorem from the conjecture by the works of many 
people including Widom, Basor, Bottcher, Silberman, Libby, and Ehrhardt. There is also a refined 
version of the conjecture by Basor and Tracy JJJ- References can be found in [2j. 
§ Fundamentally the same question has been considered by Bottcher, Embree and Trefethen [17] using 
the pseudospectra [10|,lllj. Instead of directly looking at the spectrum, they analyzed the resolvent and 
found some interesting asymptotic behaviors of the pseudospectra for a pure Fisher-Hartwig symbol. 
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determinant is a standard object in studying the eigenvalues and has been used by 
many including Widom. By applying the Fisher-Hartwig theorem, we will see that this 
determinant, as a function of (, has a line of discontinuity at the image of the symbol. 
This discontinuity, then, describes the deviation of eigenvalues from the image. We note 
that our result concerns only the eigenvalues that are near the image of the symbol and 
cannot tell much about isolated eigenvalues, or stray eigenvalues. 

The paper is organized as follows. In section 2, we explain Szego's theorem and the 
Fisher-Hartwig theorem. We then define the spectral measure and pose our problem 
of finding the asymptotic spectral measure. We explicitly calculate, for symbols with 
a single jump singularity, the asymptotic spectral measure in large n expansion. In 
section 3, we show some plots that compare our results against the numerically evaluated 
eigenvalues. 



2. Asymptotic eigenvalue distribution 

2.1. Szego's theorem and Fisher-Hartwig theorem 

Here we explain Szego's theorem and its generalization, the Fisher-Hartwig theorem. 
They describe the asymptotic behavior of the determinant for a broad class of Toeplitz 
matrices. 

Recalling that the symbol a is a function from T to complex number C, we define 
the winding of the symbol as: 

wind(a) = — / d\oga{e'P), (1) 
2vri 

where the branch of log can is taken such that it does not cross the image of the symbol. 

Szego's (strong limit) theorem states as follows. If a has no zeros on T and 
wind (a) = 0, then 

detT„(a) m 
hm ^^^ = exp E a . 2 

The two constants H{a) and E{a) are given respectively by 

oo 

if(a) = (loga)o and E(a) = ^ fc(loga)fc(loga)_fc, (3) 

fc=i 

where we define 

(loga)fe= r ^e-"^v\oga{^n- (4) 

The theorem also requires some conditions on a to make the infinite sum in E{a) ([3]) 
converge. 

If the symbol a has zeros on T or has non-zero winding then the infinite sum in 
E{a) diverges and, therefore, Szego's theorem cannot be applied. What can happen 
instead is that the determinant detT„(a) picks up an algebraic behavior in n. This is 
described by the Fisher-Hartwig theorem which we introduce next. 
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We first introduce symbols with a pure Fisher- Hartwig singularity. 

¥.^,p„(e^^):=e^^(^'-P») (pure jump), (5) 

uJa^po{e^^) := |e^^ — e^^°p" (pure modulus singularity). (6) 

Then, given an arbitrary singular symbol a, we factorize a by pure Fisher-Hartwig 
symbols and a smooth function with zero winding. Let us restrict ourselve^ to one pair 
of Fisher-Hartwig singularities, and assume a is factorized as a = Ua,po<^i3,pob with the 
conditions that a,f3 G C, Re a > —1/2 and 6 is a smooth function with zero winding. 
Then the Fisher-Hartwig theorem states that 

detT„(a) ~e"^('')n"'-^%xp[E„,^(a)] as n ^ oo. (7) 

The constant Ea^p^a) can be found, for instance, in the book [2j. Here we present the 
constant for a = 0, in the form that will be relevant for our calculation. To do this we 
define the Hilbert transform of f{t) = Xljl-oo fj^'' ^y 

or by 



r{t):=—Vt<hdT^ (8) 

TT ./ T — t 



1 1 

i=i 

In ([8]) Vt means the principal integral at r = t. From now on we will assume the 
principal integral whenever there is a pole singularity on the integration contour. 
Then we can write E{a) in ([3]) as 

E{a) = £ ^[{\oga)^{e'n]p\oga{e'n, (10) 

where the subscript p stands for the derivative in p, and the branch of the log is chosen 
to be away from the image of the symbol. Restricted to the case a = 0, the constant 
Eo^i3{a) is given by 

Eo,p{a) = Eia/ifp) + i/3 [(log a/^;3)^(e±^-) - (loga/^^)?] + log [G(l + /3)G(1 - (3)] 

^ ([(loga)%loga - [(log y.^)^], log y.^) + log [G(l + /3)G(1 - /?)] , (11) 



after a little algebra (see Appendix A ). Here (log 0/(^/3)^ is the zeroth fourier component 
of {loga/ipp)^ , and G is Barnes G-function which is an entire function defined by 

00 

G{z + 1) = (2vr)^/2e-^(^+i)/2-^-^'/2 J] {(1 + ^)'^ e-^+^'/('") |, (12) 



n=l 

where G-y ~ 0.57721... is called the Euler-Mascheroni constant. 



II A more general case involving multiple Fisher-Hartwig singularities has been considered by Basor 
and Tracy ]T5\ . 
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Figure 1. The plots of eigenvalues and the image of the symbol in the complex plane. 
The horizontal axis showes the real part and the vertical axis showes the imaginary part 
of the complex coordinate. The eigenvalues are obtained for Tn{ipp) where (3 = | 
and n = 20 for the inner dots and rt = 80 for the outer dots that are closer to a(T) 
which is represented by a line. It shows that the eigenvalues converges to the image of 
the symbol as n increases. 

2.2. Eigenvalues distribution from Toeplitz determinants 

To study the eigenvalues = l,...,n} of the matrix T„(a) we consider the 

determinant, 

n 

det[C-r„(a)] = J](C-A,). (13) 

i=l 

It is sufficient to look at this determinant in order to find out about the eigenvalues. 

For instance, the log singularities of ^ logdet[C— T!„(a)] are the places of eigenvalues. 
Szego's theorem tells us that 

-logdet[C-T„(a)]^if(C-a)= f ^ log(C - a(e^^)), (14) 

in the limit of infinite n. It is then expected that H{( — a) has a collection of log 
singularities that coalesce into a line of discontinuity. The discontinuity, being originated 
from log singularities, is purely imaginary. This fact unambiguously determines the 
location of discontinuity along a(T). As a result the eigenvalues converge to {a(e'^)} 
with the local density of eigenvalues being given by dp/27r. 

The above statement is rigorously stated by Widom [18] in the following way. If the 
convergence (fT4|) holds for almost all ^ G C, then, for an arbitrary continuous function 
/, the following convergence holds. 
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Now it is easy to improve the statement (fT^ . For simplicity, let us assume that a 
has a single jump singularity and is otherwise continuous]^ The Fisher-Hartwig theorem 
tells us that 

1 I02" 11 1 

- logdet[C - T„(a)] ~ H{C -a)- + -i?o,/3,(C - «), (16) 

where (3^ characterize the Fisher-Hartwig singularities of the symbol C — a i.e. C — a is 
factorized into fi3^b(^ with a smooth, zero-winding function 6^. 

Previously we argued that the eigenvalues approximate {a(e'P)}. By considering 
the expansion f|T6l) we expect to improve the approximation into a(e'^) + 6a{e^'^). To 
obtain the deviation 6a we simply expand as 

- logdet[C - r„(a)] r^HiC-a- 5a) -H{C-a)- ! ^ /"^f^. . (17) 

By comparing (fT7|) and (fT6l) . and by calculating the discontinuity across the image, 
we obtain 5a as 



5a(e^^) ~ idea^e''^^ 



loen 1 nC=aK)+. 
,logn^l 



(18) 

^=a(ei«)-e 

where e is an infinitesimally small complex number directed normal to the image, i.e. 
oc —idga{e^^). In the next subsection, we evaluate the above formula using (fTTj) . 



2. 3. Evaluation of the jump 

The goal of this section is to evaluate 5a{e^^) in ( JT8l) for an arbitrary continuous symbol 
a with a single jump. Without losing generality let us assume that the jump is at ±7r. 
Let us define a few functions. 

F±(0;p) := log(C - a(e'P))|^=,(ei«)±„ (19) 

where e has already been defined after f|T8l) and F± are complex-valued functions that 
coincide in the region p < 6. F± are discontinuous at p = ^ in the following way. 

F+{e;p) + i7re{p-e) = F_{e-p) -mQ{j)-9) =■ F{9-p), (20) 

where is a step function. Here we define a continuous function F by the average of 
F±. 

Evaluating the windings of ( fT9l) in a standard way by 

/5±(^):=^[^±(^;p)K::., (21) 

the jump of at C = a(e'^) ± e is obtained by 

5f5\e) := {(3^{e) + (3.{e)){(3^{e) - (3^{e)) = - [F{e;p)r=\, (22) 

vr ^ 

where F is defined at fl20|) and we use the fact, /3+(6') — /3_(^^) = —1. One also notices 
that P±{9) is expressed using 5/3^ as 2P±{9) = -5 (3'^ {9) =F 1. 

^ We believe that the case with muhiple jumps can be similarly considered using the generalized 
Fisher-Hartwig theorem. 
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In the following, we intend to express 6a of (ITSl) using the functions F (12U]) and 
5/3^ fl22|) . Let us evaluate the terms in f|T8l) one by one. First, the log ra/n-term is 
immediately given by 5/3^ ( l22l) . 

To evaluate 1/n-term let us recall the integral representation of E{a) (fTOj) using the 
Hilbert transform defined by 



vri 



for an arbitrary function /. 

Using the formula ( fTTi) and = 0, the jump of Eo^f3^{( — a) in ( |T8l) is written: 



(23) 



^o,/3c(c-a; 



|C=a(ei«)+e 
|f=a(ci«)-e 



log 



G(l + /?_(e))G(l-/3_(e))J 

- (log</'/3+(e))f log</?/3+(e) + (log¥?/3_(e))f log¥?/3_(e) 
We first evaluate the terms involving F±. Using — F" = —27TiQ{p — 6] 



(24) 



, we get 



p p — 9 

-1 I tan - + cot — - — 



Using this identity we simplify the following terms in fl24l) as 



" dp 
47r 



dp 



(F- 

" dp 
,.2^ 



+ - fXf 



(25) 



(26) 



p 



p-e\ 

tan — h cot 

2 2 / 



F{9;p). 



Similar but simpler calculation simplifies the terms involving ^p^m) as 



" dp 



(log</?/3+(e))f log(/?;3+(e) - (log(/?^_(e))^ logy?/?. 



-id) 



(27) 







L 4vr 


vri e'9 - e^P_ 



Lastly, we evaluate the term involving the Barnes G-function using the identity 

G{z + 1) = T{z)G{z) and /3_(^) = f3+{e) + 1 as following. 



log 



G(l + /3+(0))G(l-/3+(^)) 



log 



T{3/2 + 6(3\e)/2) 
r(l/2-(5/32(0)/2) 



(2^ 



G(l + /3_(^))G(l-/3_(^)). 

Substituting (!26i) . (1271) and (!28l) into (fTSi) . we obtain a simplified form of (5a(e'^) as 
follows. 



5a (e" 



i(9fla(e 



i9\ 



logn 



n 



sp\9) + - X n{e) 



n 



(29) 



nie):= I ^tan| 



p — iF(6; p) \ — i — cot 



p-9 



27C 



F{e-p) 



+ log 



r(3/2 + ,5/3^(g)/2) 

_r(i/2-5/?2(^)/2)_ • 
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Recall that the eigenvalues approximate {a{&P) with the local density of eigenvalues 
being given by dp/2'ir. We have improved the approximation to {a(e^^) + 5a(e'^)}. Our 
result ( l29l) gives the deviation 6a for an arbitrary symbol a with a single jump singularity. 
In the next section, we demonstrate how this result works by comparing (5a(e^^) and the 
deviation of eigenvalues from a(e'^). 



3. Examples and discussion 

3.1. Numerical comparison 

Here we present an example to illustrate our result (129|) . We will show that the 
eigenvalues approximate {a(e'^) + 5a(e'^)} with the local density of eigenvalues being 
uniformly distributed in 6* G [— vr, tt). To do this we choose a most uniformly distributed 
set {9j} by 9j = ^(j — |) — vr. And we order the eigenvalues A/s such that they are 
close to a(e'^^)'s. This ordering is a straightforward procedure in the example we will 
present. To show that the eigenvalues {Xj} are approximated by {a(e'^-') + 6a{e^^^)}, we 
plot the actual deviations {Xj — a(e'^-')} against the predicted deviations {Sa{e^^^)} to 
see whether they are close to each other. 

We take as our symbol a pure Fisher-Hartwig symbol a(e'^) = e^^^ with a general 
complex p. Figure [2] shows the plot for /3 = | + i|. The blue dots are the actual 
deviations and the red line is the theoretical prediction. They are in good agreement. 
(See the caption of the figure for more details.) 

Being obtained from a perturbative analysis the agreement is of course not perfect. 
Also there seems to be an interesting divergence near the ends of the distribution. We 
discuss such aspects in the discussion section. 

Below we explain how we made these plots. To get the deviation 6a{e^^) from (1291) 
one only has to evaluate the function F{6;p) since the other function 5 (3'^ {6) is obtained 
from the former by ( l22l) . Plugging C, = e^^ into log[C — e'^^], and taking the continuous 
part (i.e. removing the term with Q{p ~ 6)) we get 



F(6'; p) = ^f3{p + e + 7i) +\og2 + i arctan 



cos(/?fiV)sinh(/?,g^) 
cosh(/3,^)sin(/?«^) 



^ 1 ^osh f3i{e -p) - cos Pnjd-P) ^ 

where j3 = + i/3/ and we take the standard branch of arctan. 

We use the Mathematica to evaluate the integral in fl29|) . Especially, the principal 
integral at p = 6' is done by the built-in function in the Mathematica, and the other at 
p = TT is taken care of by adding an appropriate null integrand, which is proportional to 
tan(p/2), to make the integrand to be finite at p = vr. The numerical evaluation of the 
eigenvalues is also done with Mathematica. 
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Figure 2. The deviations of eigenvalues from the image of the symbol and the 
theoretical predictions. The blue dots are [Aj — a(e'^^ )]/a(e'^J ) v.s. 9j. 9j is given 
by ~ l) ^ '^^'^ ^'^'^ ^^'^ theoretical prediction for the blue dots and is 

given by (5a(e'^)/a(e'^) v.s. 6. The top (a) and the bottom (b) show, respectively, the 
real and the imaginary part of the plots. The eigenvalues are obtained for the matrix 
Tnie^^^) where (3 is given by /3 = | + i| and the size is n = 200. Though we observed 
more strong match as we increase n up to 1000 we show the lower n because the dots 
become indistinguishable at a higher n. One can see from the formula ([29|) that the 
y-axis is of the order logn/n. Because the da has both logn/n and 1/n components 
the plots are not scale invariant with n. 
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3.2. Conclusion and discussion 

It has been observed (and even proven in some cases) that the eigenvalues of certain 
Toephtz matrix approximate the image of the symbol. In this paper we have contributed 
to the situation by obtaining the leading approximation of the deviations between the 
eigenvalues and the image of the symbol. 

We have derived an explicit formula for an arbitrary symbol with a single jump 
singularity, and we have demonstrate our result using a specific example using a pure 
Fisher- Hart wig symbol. Since our method is quite general we believe it can be applied 
to a broader class of symbols. We believe that the symbols with multiple jumps can 
be dealt with using the generalized Fisher-Hartwig theorem. Currently, however, we do 
not know how to deal with symbols without jump singularity because we do not know 
how to evaluate det[( — T{a)] in large n limit when ( is inside the "closed curve" given 
by a(T). 

Though figure [2] shows excellent agreement it is not totally obvious why. The 
subtlety lies when we choose 6j by the most uniformly distributed points. The theory 
tells that the density of eigenvalues are "uniform" in 6. But it does not tell whether it 
is exactly given 6j^s. Actually there are many ways to put points with uniform density, 
for instance, we can move a finite number points while keeping the uniform density 
in the limit of infinite n. We suspect that this strict uniformity of the eigenvalue 
distribution seems to require more careful analysis which may even provide a bound to 
our perturbative analysis. 

In figure [2] we could observe an interesting structure near the ends of the spectrum. 
Both the real part and the imaginary part of (5a(e'^) turn out to have a divergence at 
6 = ±7r. For a real /3, the most dominant structure of the divergence is captured as 
follows. 

6a{&^) i flogn 1 



, I log(vr-^) + -[log(vr-^^)]M, (31) 

near 6 = tt. From the formula, one notices that the dominant divergences contributes 
only to the imaginary part, and, quite interestingly, that they exchange their dominance 
according whether logn S> | log(7r — 6) \ or logn <^ | log(7r — 0)\. This competition seems 
to be making the hook-shaped structure near = tt in figure [2] showing the imaginary 
part. Because of these divergence the scaling, logn/n and 1/n, of the deviations does 
not apply to the eigenvalues near the ends of spectrum. One can expect from figure 
|2] that the eigenvalues near the ends of the spectrum are distributed in a qualitatively 
different way from those in between. For instance, we obtain the dominant behavior of 
~ ^°si^°sn)iogn ^j^^ eigenvalue nearest to the end when we naively apply our result 



( l29l) to the first eigenvalue. 
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Appendix A. Derivation of (1111) 



The derivation goes as follows. The log of (ffs can be expanded in the following way. 



pifcp 

log^^ = (3 [log(l + e'n - log(l + e-^)] = -(3 ^(-1)^—. (A.l) 



Using this expansion we evaluate the following for an arbitrary function b. 

r ^ [(log &)^], logy., = -/5^i^(-ifc)(log6^)_, (A.2) 

= i/?[log6^(e±-)-(log6^)o]. (A.3) 

Here the Hilbert transforms are taken not on b but on log 6. One can also check that 
/-vr ^[0-'^Sfi3)^]p^(^Sb gives exactly the same result. As a result we prove the identity 
( ITTl) in the following way. 

dp 

— ([(loga)%loga - [{\ogipp)%\ogipp) - E{a/^p) 
^ dp 

— ([(loga)^]plog^, + [(log^/3)^]ploga -2[(log(^/3)^]plog<^/3) 

■TT 

^^([(loga)a-[(log^,)%) log 
i/3 [(loga/^,)^(e±-)-(loga/^,)^]. 
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